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Abstract 

Background: In clinical trials in childhood asthma, outcomes reflecting short-term disease activity are frequently 
measured, whilst functional status, quality of life (QoL), and long-term treatment effects are rarely assessed. There is 
also non-uniformity across studies in the selection and measurement of outcomes within these domains. The 
development of a core outcome set has the potential to reduce heterogeneity between trials, lead to research that 
is more likely to have measured relevant outcomes, and enhance the value of evidence synthesis by reducing the 
risk of outcome reporting bias and ensuring that all trials contribute usable information. 

Methods: Paediatricians and specialist nurses, identified through the British Paediatric Respiratory Society, 
completed a two-round Delphi survey. Separate cohorts of parents of children younger than 18 years, recruited in 
clinics, participated in each round. Young people with asthma, aged at least 13 years, participated in the first round. 
Outcomes were identified separately for preschool and school-aged children. 

We identified outcomes considered important in routine clinical assessment by clinicians and parents/young 
people. In round 1, 46 clinicians suggested outcomes they considered important when deciding whether to adjust 
a child's asthma therapy regime, and 49 parents/young people were asked, using open questions, how they judged 
whether their child's (for young people, their own) asthma therapy was appropriate. Two researchers independently 
classified responses into appropriate, corresponding outcomes. 

In round 2, 43 clinicians and 50 parents scored, from 0-4, the importance of each outcome suggested by at least 
10 % of round 1 responders and selected the three most important. 

Results: The most important outcomes, when making shared decisions about regular therapies for school-aged 
and preschool children with asthma, were daytime and nocturnal symptoms, exacerbations, QoL, and mortality. 
Results from parents and clinicians were generally concordant, but parents placed more emphasis on long-term 
treatment effects. 

Conclusions: We have developed a methodology to identify outcomes of most relevance to clinicians, parents, 
and young people when evaluating regularly administered therapies for asthma. Daytime and nocturnal symptoms, 
exacerbations, QoL, and mortality are particularly important outcomes that should be measured and reported in all 
clinical trials of regular therapies for children with asthma. 
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Background 

To inform clinical practice, clinical trials that aim to de- 
termine benefits and risks of treatments should measure 
outcomes that are important to patients, and useful to 
clinicians and policymakers. It can be difficult, however, 
for trialists to know which outcomes are most important 
for a given condition. Chronic illnesses can affect the 
lives of patients and families in a variety of ways, each of 
which can potentially be improved by an intervention 
and could therefore be measured as an outcome. 

In a systematic review, of studies that aimed to deter- 
mine which outcomes to measure in clinical trials in 
children [1], we found only one study relating to asthma 
[2]. In this study, 14 clinicians and researchers indicated, 
by questionnaire, which outcomes they felt were most 
appropriate for a variety of clinical, public health, and re- 
search settings related to asthma. More recently, the 
American Thoracic Society (ATS) and European Re- 
spiratory Society (ERS) held workshops, attended by 24 
clinical researchers, with the aim of recommending 
which outcomes to select in clinical trials of regular 
therapies for asthma and how these could be measured 
in a standardised manner [3]. These recommendations 
relate to adults and adolescents, but the authors suggest 
that, with some special considerations, the outcomes 
could also be relevant for children older than 6 years. 

In another systematic review, we aimed to identify 
which outcomes and domains were measured in rando- 
mised controlled trials (RCTs) of inhaled corticosteroids 
for children with asthma [4]. We found that studies al- 
most always measure clinical and physiological markers 
of short-term disease activity, but quality of life (QoL), 
functional status, and long-term outcomes are rarely 
assessed. We also noted marked inconsistency between 
studies in the way that particular outcomes are mea- 
sured and reported, and non-uniformity in the defini- 
tions of clinical events, especially exacerbations, used as 
endpoints. 

We recommended that one solution to these problems 
would be to agree on a minimum set of core outcomes 
that should be measured and reported in all RCTs that as- 
sess the effectiveness of treatments given to prevent symp- 
toms and complications in children with asthma. Core 
outcome sets increase the likelihood that important out- 
comes will be measured, improve evidence synthesis by 
reducing heterogeneity between studies, and reduce 
outcome-reporting bias [5]. Such core outcome sets have 
been implemented in other conditions, notably in the field 
of rheumatology. The OMERACT (Outcome Measures in 
Rheumatology) collaboration has designed core outcome 
sets for various conditions by reaching consensus amongst 
clinicians and researchers about which outcomes to meas- 
ure [6], and more recently by asking patients which out- 
comes they feel are most important [7]. The COMET 



(Core Outcome Measures in Effectiveness Trials) Initiative 
brings together researchers interested in the development 
and application of core outcome sets [8]. Data on over 
120 published or on-going studies related to core outcome 
set development have been entered into the COMET re- 
pository (http://www.comet-initiative.org.). The outcomes 
measured in clinical trials, in order to evaluate whether 
the benefits of a treatment outweigh its harms, should be 
aligned to the assessments that are used in clinical prac- 
tice to decide whether a treatment regime is satisfactory. 
Core outcome sets do not need to comprise an extensive 
list of outcomes, but rather a few particularly important 
ones that reflect the ways in which patients, families, and 
clinicians assess whether a treatment regime is satisfac- 
tory, and make shared decisions about whether to con- 
tinue or modify it. There is little guidance, however, for 
researchers who wish to involve these groups in the devel- 
opment of a core outcome set. 

The aim of this study, therefore, was to develop and 
pilot a method by which to identify outcomes of particular 
relevance when evaluating the effects of regular therapies 
for chronic childhood asthma, from the perspective of 
clinicians involved in the out-patient management of chil- 
dren with asthma, parents of children younger than 
18 years, and young people aged between 13 and 18 years. 
In previous attempts to develop core outcomes sets, parti- 
cipants have generally considered outcomes that had 
already been measured in clinical trials [8,9]. This ap- 
proach may overlook important outcomes if they have not 
previously been routinely measured and perpetuate the in- 
clusion of others, which may be less relevant. We there- 
fore took an empirical approach of focusing on aspects of 
a child's symptoms or history that would lead to a conclu- 
sion by a clinician, parent, or young person that treatment 
was either adequate or not. 

Methods 

Ethics statement 

We asked the advice of the National Research Ethics 
Service (NRES) about whether this study required ethical 
review by an NHS Research Ethics Committee, and they 
advised that this should be considered as service evalu- 
ation and development. No identifiable details about 
patients or families were collected. To acknowledge the 
clinicians who participated in the study, we have listed 
them, having obtained consent individually to do so, in 
Additional file 1. 

This study was conducted, using questionnaires, in two 
phases (1 and 2). The purpose of phase 1 was to identify a 
long list of potential outcomes, and phase 2 was designed 
to identify which of these were most important. Partici- 
pants were asked to consider outcomes for evaluating 
therapies taken regularly rather than for acute exacerba- 
tions. Outcomes for preschool (younger than 5 years) and 
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school- aged (at least 5 but not yet 18 years) children were 
considered separately. This was because not all outcomes 
can be measured in younger children, and different out- 
comes may have varying relevance at different ages. For 
example, physiological tests of lung function are rarely 
measured in preschool children because of technical diffi- 
culties, and functional status may be assessed in different 
ways because the pattern of normal daily activities changes 
when children start school. 

To ascertain the views of clinicians, all members of 
the British Paediatric Respiratory Society (BPRS) and a 
network of asthma nurses were invited to participate 
in a two-round, web-based, anonymised Delphi survey. 
The Delphi technique, which has been used to develop 
other core outcome sets [9], is a structured method 
for reaching consensus, in which participants complete 
sequential rounds of questionnaires, with the results of 
each questionnaire informing the composition of the 
next. The BPRS comprises medical and non-medical 
professionals within the UK who care for children with 
respiratory problems. To be eligible to participate, we 
invited clinicians and nurses who had current experi- 
ence of managing children with asthma, but not ne- 
cessarily experience of designing or conducting clinical 
trials. The selection of participants on the basis of 
relevant clinical experience, rather than research ex- 
pertise, differs from the approach generally taken when 
core outcome sets have been developed. 

Parents were invited to complete paper-based surveys in 
asthma clinics in Alder Hey Children's Hospital (AHCH), 
a large paediatric hospital in the North of England, where 
patients are referred from primary and secondary care. 
Parents of all children younger than 18 years who were 
prescribed regular preventer therapy for asthma and did 
not have respiratory co-morbidities were eligible. Young 
people aged 13 to 18 who attended these clinics were also 
invited, because we anticipated that they might have dif- 
ferent goals for their asthma treatment. The lower age 
limit was based on clinical experience that teenagers are 
generally more able to discuss their asthma than younger 
children. When participants were approached in the out- 
patient department, one reviewer (IS) explained verbally 
what was meant by the terms clinical trials and outcomes, 
and why we were conducting the study. We elected to use 
questionnaires rather than focus groups to minimise the 
burden on participants and to enable the involvement of a 
larger sample. We also felt that participants' opinions did 
not require in-depth analysis, which would have been best 
answered using qualitative research techniques. 

Phase 1 

Phase 1 comprised the first round of the Delphi survey 
of clinicians, and a survey of parents and young people. 
Open questions were asked in order to identify a long 



list of outcomes that could be relevant to clinic consulta- 
tions. In a pilot phase, we asked parents and young 
people with asthma, and a group of young people with 
experience of reading clinical trial information leaflets 
whether the questions were easy to understand and ap- 
propriate; the questions were then refined accordingly 
with extensive input from parents and young people. 
The questions included in the questionnaires are listed 
in Table 1. 

IS interpreted each response from clinicians, parents, 
and young people, and decided which outcome of treat- 
ment was being described. The broad framework for 
classifying responses as outcomes was based on the 
domains, subdomains, and outcomes identified in the 
systematic review described earlier [4]. This comprised 
the following six categories: 

• Short-term disease activity: Symptoms; relief inhaler 
use; exacerbations; lung function; overall asthma 
control 

• Physical consequences of disease: death; progression 
of asthma into later childhood or adulthood 

• Functional status: ability to exercise or play sport; 
activities of daily living; school attendance 

• Family outcomes and Quality of Life: overall QoL; 
emotional well-being; family outcomes 

• Adverse effects of therapy: short-term adverse 
effects; long-term adverse effects 

• Health resource utilisation 

Four reviewers (IS, RG, PRW, RLS) discussed whether 
each of the responses that did not fit into this classifica- 
tion should constitute a new' outcome. 

In order to identify responses that were open to inter- 
pretation and to make categorisation of responses more 
accurate, reviewer 2 (RG) independently categorised the 
first 36 (72 %) questionnaires received from parents and 
young people, and reviewer 3 (PRW) independently ana- 
lysed a randomly selected sample of 9/46 (20 %) of the 
questionnaires completed by clinicians. Disagreements 
were discussed among all four reviewers. Further review 
of the responses from parents and young people was not 
deemed necessary because interpretation of responses 
became easier and agreement became greater as the 
study progressed. The responses from clinicians were 
easier to interpret and categorise, and agreement among 
reviewers was excellent, so further review of these ques- 
tionnaires was not deemed necessary. 

To enable each group of participants, regardless of its 
size, to have equal opportunity to suggest outcomes for 
phase 2, those outcomes suggested by at least 10 % of 
young people and/or parents and/or clinicians were car- 
ried forward to the next phase. By censoring in this way, 
we reduced the number of outcomes listed on the phase 
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Table 1 Questions asked in the phase 1 questionnaires 
distributed to clinicians, parents, and young people 

Clinician questionnaire "When you see children with asthma in clinic, 
you make an assessment as to whether their 
treatment is working. Please list up to five 
beneficial or harmful outcomes of treatment 
that you find clinically most important in 
school-aged/preschool children. These factors 
should be things that you consider, when 
deciding whether to recommend continuing 
on current treatment or altering a child's 
regular asthma therapy regime" 

Parents (young peoples') "Over the last 12 months, have you generally 
questionnaire felt that the regular preventer treatment that 

your child (you) takes has kept their asthma 
under control? Yes/No. If you ticked YES, 
please tell us what aspects of your child's 
(your) asthma, or their daily life, have made 
you feel happy that they are on the correct 
regular medication. If you ticked NO, please 
leave this question blank" 

"Over the last 12 months, have there been 
times when you felt that your child's (your) 
regular preventer treatment should be 
increased or changed, because their (your) 
asthma was not under control? Yes/No. If you 
ticked YES, please tell us the reasons why you 
were not satisfied with the regular preventer 
treatment that they (you) were taking? If you 
ticked NO, please leave this space blank" 

"Does anything worry you about the fact that 
your child (you) has asthma? Yes/No. If you 
ticked YES, please tell us the worries you have 
about the fact your child (you) has asthma. If 
you ticked NO, please leave this space blank" 

"Does anything worry you about the regular 
preventer treatment that your child (you) takes 
for their asthma? Yes/No. If you ticked YES, 
please tell us what worries you have about the 
treatment your child takes for their asthma. 
Please be as specific as you can. If you ticked 
NO, please leave this question blank" 



2 questionnaire, without overlooking outcomes of poten- 
tially genuine importance. The reviewers discussed the 
individual outcomes that had not been suggested by suffi- 
cient numbers of participants, but were measured in at 
least 10 % of RCTs identified in the systematic review 
described earlier [4]. If nearly 10 % of both clinicians and 
parents suggested the outcome, it was carried forward to 
the next phase, because we felt that, if we had a larger 
sample size, the outcome may have been suggested by 
sufficient numbers of participants. 

The study flowchart is shown in Figure 1. At the start of 
the study, 260 members of the BPRS and 21 specialist 
asthma nurses were invited to participate. Of the 46 
respondents, who came from both district general hospitals 
and tertiary respiratory centres, 38 were paediatricians (of 
whom 16 were specialist respiratory paediatricians, 16 were 
general paediatricians, and 6 were clinical academics), and 



8 were respiratory nurses. The participants are listed in 
Additional file 1. In total, 38 parents (of whom 27 attended 
with school-aged children and 11 attended with preschool 
children) and 11 young people, ranging from 13 to 15 years, 
participated in phase 1. 

Phase 2 

Only the clinicians who participated in phase 1 were 
invited to complete the phase 2 questionnaire. We 
assumed that if clinicians did not respond to phase 1, 
they would be unwilling or unable to participate in 
phase 2, so we took the pragmatic decision not to con- 
tact them again at this stage. Parents attending asthma 
clinics at AHCH were invited to participate, employing 
the same eligibility criteria as those used in phase 1. We 
felt confident in running a Delphi process with clini- 
cians, but felt that questionnaires to parents should be 
delivered in person, so that the questions could be 
explained. The advantages of doing so would be that the 
questions would be better understood, and the response 
rate to the phase 2 questionnaire would be higher. We 
decided to use a new cohort for the second round of the 
study so that parents involved in phase 1 would not 
need to be contacted outside their clinic appointment. 
We felt that two cohorts would be sufficiently similar to 
enable this approach because phases 1 and 2 were con- 
ducted in identical clinics, so we assumed that family 
demographics and the severity of the children's asthma, 
were comparable across the two phases of the study. 

When parents were invited to participate, the recruiting 
researcher (IS) explained the purpose of the study and the 
use of the term outcome' verbally. To increase numbers, 
parents of preschool children were recruited at a local dis- 
trict general hospital, whose paediatric respiratory depart- 
ment treats children with asthma with broadly similar 
characteristics to those seen at AHCH. As it was unclear 
whether young people would be able to answer the ques- 
tionnaire in phase 2, they were not included. Unlike ques- 
tions asked in phase 1, those questions asked in phase 2 
did not reflect actual discussions that take place with 
young people in clinic consultations. We felt that in order 
to involve young people in phase 2, the questionnaires 
would need to be rigorously validated in this population, 
and this would be outside the scope of the study. In an- 
other attempt to increase the size of the sample, the phase 
2 questionnaire was distributed by Asthma UK, the largest 
UK-based asthma charity, to parents of children with 
asthma, who had previously expressed an interest in being 
involved in clinical research. 

The questionnaires distributed to parents and clinicians 
in phase 2 are included in Additional file 2. To identify the 
relative importance of each outcome, participants were 
asked the following question: "Regular treatments for chil- 
dren can have a variety of beneficial effects, each of which 



Sinha et al. Trials 2012, 13:103 
http://www.trialsjournal.eom/content/1 3/1 /1 03 



Page 5 of 9 



Phase 1: 

Open 
questions to 
identify 
potential 
outcomes 



Outcomes listed by 
10% of participants 
carried forward 



Clinician Delphi 



281 invited to Phase 1 


> 


f 


46 completed Phase 1 






► 



dropped 
out 



Parent surveys (2 cohorts) 



52 invited to Phase 1 



49 completed Phase 1 



¥ 3 declined 



27 parent* of school age 

children 

17/27 aged S 12, 
10/27 aged 12-18; 

ch Id'en, 

all aged 1-5 
11 young people 
all aged 13-15 



Phase 2: 

Closed 
questions to 
identify most 
important 
outcomes 



45 invited to Phase 2 



dropped 
out 



43 completed Phase 2 



51 invited to Phase 2 



1 declined 



50 completed Phase 2 



27 Mrentt of xhool- m 
children 

18/27 aged 5-12. 

9/27 aged 1218; 

23 Mfcniiof pagfaori 

children 

2/23 aged <1, 
21/23 aged 1-5 



Figure 1 Study flowchart showing participants in each phase of the study. 



could be measured as an outcome in clinical trials. Please 
score how important each of the following outcomes are 
on a scale of 0-4". They were also asked to pick the three 
outcomes they felt were most important. In order to en- 
sure that important outcomes were not missed, partici- 
pants were asked to suggest any unlisted outcomes that 
they would have selected in their top 3. 

The results from clinicians and parents were ana- 
lysed separately, and those of parents of preschool 
children were analysed separately from those of par- 
ents of school-aged children. Each outcome was 
ranked in terms of the proportion of participants who 
selected it in their top 3. 

Phase 2 was completed by 43 clinicians and 50 parents 
(of whom 27 attended with school-aged children and 23 
attended with preschool children). In spite of several 
reminders, only 13/118 (11 %) responses were received 
from Asthma UK. As a result, these data have not been 
included in our analyses. 



Results 

Identification of outcomes in phase 1 

The results of phase 1 are shown in Additional file 3. 
Participants suggested a total of 29 outcomes, of which 
symptoms, and their effect on ability to exercise and lead 
a normal life, exacerbations, and adverse effects of ther- 
apy were most frequently suggested. One outcome 
(QoL) was carried forward to the phase 2 questionnaire 
for preschool children despite not being suggested by 
10 % of any group of participants, because it was sug- 
gested by 9 % of both parents and clinicians. 

There was good agreement among reviewers with 
regards to how most responses should be categorised, 
according to the framework of outcomes described earl- 
ier. Responses relating to long-term outcomes, however, 
were more difficult to categorise, because it was often 
unclear whether participants referred to future risk of 
asthma, other respiratory illness, general health pro- 
blems, or effects on activities of daily living, and we were 
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unsure whether these related to later childhood or adult- 
hood. We felt it would be appropriate to combine these 
responses into the outcome 'health-related problems 
when older'. A summary of the agreement among 
reviewers is shown in Additional file 4. 

Ranking of outcomes in phase 2 

All the outcomes listed in the phase 2 questionnaire 
were considered important. By asking participants to se- 
lect their top 3, we were able to identify those of particu- 
lar importance. 

The results for each outcome listed in the phase 2 
questionnaire relating to preschool children are shown 
in Table 2. The most important outcomes for clinicians 
and parents were symptoms, especially those arising at 
nighttime, exacerbations, QoL, mortality, and hospital 
admission. The results for each outcome listed in the 
phase 2 questionnaire relating to school-aged children 
are shown in Table 3. The most important outcomes in 
this age group were symptoms, exacerbations, QoL, abil- 
ity to perform normal activities, and mortality. 

Parents and clinicians generally agreed on which out- 
comes were most important. However, parents, of both 
preschool and school-aged children, scored long-term 
outcomes more highly than did clinicians. Both parents 
and clinicians considered long-term adverse effects of 
therapy more important than short-term adverse effects. 

Table 2 Preschool children: the importance of each outcome listed in the phase 2 questionnaire, as scored by 
clinicians and parents 



Discussion 

Main findings 

We found that the outcomes considered most important 
in childhood asthma by clinicians, patients, and parents 
were symptoms, exacerbations, quality of life, and mor- 
tality. We identified these by asking clinicians, parents, 
and young people, what outcomes they reviewed or 
reported during routine clinical consultations to enable 
them to decide, jointly, whether or not therapy should 
be continued, augmented, or reduced. This differs from 
the approach generally taken in deciding outcomes for 
clinical trials, which is to focus on what has been mea- 
sured before [9]. In this pilot study, we have shown that 
it is feasible, and useful, to involve clinicians, patients, 
and families, in identifying which outcomes are import- 
ant when making shared decisions about management in 
clinical practice. 

The frequency and severity of symptoms and exacer- 
bations are important for clinicians and trialists in decid- 
ing whether asthma is well controlled [10], so it is 
unsurprising that they emerged as important compo- 
nents of a core outcome set in this area. Although lung 
function is frequently assessed in asthma clinical trials 
because it is an objective evaluation of efficacy, we found 
that parents and clinicians place much more emphasis 
on clinical measures of asthma control when assessing 
the effectiveness of therapy. 





Clinicians 

(n = 43) 






Parents 

(n = 23) 






Outcome 


Clinician rank 


Median 
(IQR) 


Number (%) scoring 
outcome in top 3 


Parent rank 


Median 
(IQR) 


Number (%) scoring 
outcome in top 3 


Nocturnal symptoms 


1 


4 (3, 4) 


19 (44) 


1 = 


4 (4, 4) 


10 (43) 


Exacerbations 


2 


4 (3, 4) 


15 (35) 


3 


4 (4, 4) 


7(30) 


Quality of life 


3 


3 (3, 4) 


13 (30) 


4 


4 (3, 4) 


5(22) 


Daytime symptoms 


4 


4 (3, 4) 


1 1 (26) 


10 


4 (3, 4) 


3(13) 


Death 


5 


4 (2, 4) 


10 (23) 


1 = 


4 (4, 4) 


10 (43) 


Hospital admission 


6 


4 (3, 4) 


9(21) 


7 


4 (4, 4) 


4(17) 


Parent/child global assessment 
of control 


7 


4 (3, 4) 


9(21) 


11 


4 (3, 4) 


3(13) 


Impact of asthma on the family 


8 


4 (3, 4) 


8(19) 


16 


4 (3, 4) 


1 (4) 


Use of reliever 


9 


3 (3, 4) 


8(19) 


8 


4 (3, 4) 


4(17) 


Normal activities 


10 


4 (3, 4) 


5(12) 


14 


4 (3, 4) 


2(9) 


Long-term AE 


11 


4 (3, 4) 


7(16) 


13 


4 (4, 4) 


2(9) 


School attendance 


12 


3 (3, 4) 


5 (12) 


6 


4 (3, 4) 


5 (22) 


Activity or exercise 


13 


3 (3, 4) 


4(9) 


12 


3 (2, 4) 


3(13) 


GP/A + E attendance 


14 


4 (3, 4) 


4(9) 


15 


4 (3, 4) 


2(9) 


Growth 


15 


3 (3, 4) 


3(7) 


9 


4 (3, 4) 


3(13) 


Health-related problems when older 


16 


3 (2, 4) 


0 


5 


4 (4, 4) 


5(22) 


Short-term AE 


17 


3 (2, 3) 


0 


17 


3 (3, 4) 


0 
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Table 3 School-age children: The importance of each outcome listed in the phase 2 questionnaire, as scored by 
clinicians and parents 





Clinicians 

in = 43) 






Parents 

In = 27) 






Outcome 


Rank (n/17) 


Median 
(IQR) 


Number (%) scoring 
outcome in top 3 


Rank 


Median 
(IQR) 


Number (%) scoring 
outcome in top 3 


Quality of Life 


1 


4 (3, 4) 


20 (47) 


2 


4 (4, 4) 


9(33) 


Exacerbations 


2 


4 (4, 4) 


18 (42) 


3 


4 (4, 4) 


9(33) 


Nocturnal symptoms 


3 


4 (4, 4) 


16(37) 


4 


4 (4, 4) 


8(30) 


Normal activities 


4 


4 (4, 4) 


12 (28) 


8= 


4 (4, 4) 


4(15) 


Daytime symptoms 


5 


4 (4, 4) 


11 (26) 


6 


4 (4, 4) 


6 (22) 


Death 


6 


4 (2, 4) 


1 1 (26) 


1 


4 (4, 4) 


14(52) 


Use of reliever inhaler 


7 


4 (3, 4) 


9 (21) 


10 


4 (3, 4) 


3 (11) 


Hospital admission 


8 


4 (3, 4) 


8 (19) 


12 


4 (4, 4) 


2 (7) 


Activity or exercise 


9 


4 (3, 4) 


7 (16) 


5 


4 (3, 4) 


7 (26) 


Long-term adverse effect 


10 


4 (4, 4) 


7(16) 


8= 


4 (4.4) 


4(15) 


School attendance 


11 


4 (3, 4) 


7(16) 


11 


4 (4, 4) 


2(7) 


Parent/child global assessment 
of control 


12 


4 (3, 4) 


7(16) 


14 


4 (3, 4) 


2(7) 


Lung function tests 


13 


3 (2, 3) 


5(12) 


15 


4 (3, 4) 


1 (4) 


GP/A + E attendance 


14 


4 (3, 4) 


3(7) 


16 


4 (3, 4) 


0 


Growth 


15 


4 (3, 4) 


2(5) 


13 


4 (3, 4) 


2(7) 


Health-related problems when older 


16 


3 (2, 4) 


0 


7 


4 (4, 4) 


5(19) 


Short-term adverse effect 


17 


3 (2, 3) 


0 


17 


4 (3, 4) 


0 



We found that, in all age groups, the effects of inter- 
ventions on measures of functional status, such as the 
ability to perform normal activities, play sports, and at- 
tend school, and also on overall QoL, were fundamental 
to the assessment of their benefit. Clinical markers of 
disease, which do not evaluate psychosocial and func- 
tional effects of having asthma [10], should not be used 
as substitutes for such assessments [11]. Although QoL 
outcomes are assessed relatively infrequently in clinical 
trials in asthma [4], we recommend that they be 
included in a core outcome set, either as individual com- 
ponents of functional status or emotional well-being, or 
as part of a validated composite outcome. 

We found that parents place more emphasis on long- 
term beneficial effects of therapy than clinicians do. Previ- 
ous qualitative research has identified that many parents 
of children with asthma worry about long-term effects on 
health [12], and cohort studies suggest that children with 
asthma are likely to continue to have asthma as adults 
[13]. Long-term harmful effects of therapies were import- 
ant to both clinicians and parents in our study. These have 
also been shown to be a major concern for parents and 
children [14], and are an important research priority [15]. 
We feel that, despite difficulties of measuring long-term 
effects of therapies, they should be also be part of a core 
outcome set, although further work is needed to identify 



the most appropriate ways to measure and report these 
outcomes. Around half of the parents who participated in 
phase 2 selected prevention of death' as one of their top 
three outcomes, compared with a quarter of clinicians. 
One reason for this discrepancy may be that clinicians 
may feel that because death from asthma in childhood is 
very rare, it should not be part of a core outcome set. 
We recommend, however, that death should always be 
reported as a secondary outcome in clinical trials in chil- 
dren with asthma. 

Comparison with the ATS/ERS outcomes taskforce 

As mentioned earlier, a recent ATS/ERS taskforce [3] has 
recommended outcomes that should be measured in 
clinical trials of regular therapies in asthma. Outcomes 
measured in clinical trials were identified by a literature 
review. Working groups comprising clinicians, research- 
ers, and pharmaceutical industry representatives, reached 
consensus using round-table open discussions about the 
suitability of these outcomes for evaluating current and 
future asthma-related problems. Two paediatricians 
assessed whether the recommendations were applicable 
to clinical trials in children. 

The recommended outcomes, which were symptoms, 
use of reliever inhaler, composite scores for assessing 
asthma control, exacerbations, quality of life, pre- and 
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post-bronchodilator FEV1 (for assessment of lung func- 
tion decline), and adverse effects of therapy, are compar- 
able with our results. The main difference was that 
participants in our study considered physiological mea- 
sures of lung function, although 'essential' outcomes in 
the ATS/ERS core set, one of the least important out- 
comes. Other groups have also highlighted issues relat- 
ing to whether or not outcomes measured in clinical 
trials in adults are applicable to children [16]. The dis- 
crepancy may also reflect our empirical approach of con- 
sidering the importance of outcomes in the context of 
factors that affect decisions in a clinic consultation com- 
pared to the ATS/ERS approach of starting with what 
has been measured previously and assessing the rele- 
vance of those outcomes. We acknowledge that FEV1 
will continue to be measured in clinical trials in asthma, 
because it is reliable and repeatable, but our work high- 
lights that other outcomes are of more importance when 
making clinical decisions. 

Limitations of this study 

Our sample focussed on children whose asthma is mana- 
ged by hospital paediatricians, although much asthma is 
treated in primary care. The study should be replicated 
amongst primary care doctors, practice nurses, parents 
with children whose asthma is managed in primary care, 
and young people who are treated in this setting. This 
will also address the fact that only small numbers of 
young people were included in our study in phase 1. We 
feel, however, that our results are relevant to a high pro- 
portion of clinical trials, which are usually conducted in 
the hospital setting [17-19]. We have also sampled parti- 
cipants from the UK, and it is possible that if this study 
were replicated in other countries, some other outcomes 
may have been found to be of particular importance. For 
this reason, we feel that future work to develop a more 
definitive core outcome set for childhood asthma, which 
is broadly applicable internationally, should incorporate 
the views of participants from several countries. 

Despite good agreement among reviewers, certain 
responses in phase 1 were open to interpretation. One ex- 
ample related to the description of symptoms. Although 
some parents specified daytime or nocturnal symptoms, 
others did not. A pragmatic decision was taken that a de- 
scription of symptoms should be classified as referring to 
nocturnal symptoms only if the response was this specific. 
If our assumption had been false, the number of partici- 
pants suggesting night-ime symptoms' could have been 
underestimated in phase 1, or those suggesting 'daytime 
symptoms' could have been overestimated. Ultimately, our 
results appear to be robust to this decision, because noc- 
turnal symptoms were included in the phase 2 question- 
naire, and daytime symptoms scored highly. 



Responses from parents in phase 1 that were classified 
as representing QoL were also open to interpretation. 
However, even if we had misinterpreted some responses 
from parents, in phase 1, this is unlikely to have affected 
the phase 2 questionnaire. We kept a broad definition of 
QoL that reflects a patient's overall well-being, including 
psychosocial status. A detailed examination of what parti- 
cipants meant by QoL was outside the scope of this study. 

Our sample of clinicians represented only 18 % of 
people to whom the invitation was sent, although our 
sample size is comparable to other studies that have 
attempted to determine which outcomes to measure in 
clinical trials [9]. It is possible that this may have 
resulted in bias towards participants with specific inter- 
est in this type of study. Although we cannot be certain 
about the views of the 214 non-responders, we see no 
reason why this group should differ from those who did 
respond. We assumed that these clinicians did not want 
to be involved in the study, or were too busy, so we felt 
it would be inappropriate to send them an email inviting 
them to phase 2. 

Conclusions 

In this study, we have developed and piloted a method for 
involving patients, parents, and clinicians in the process of 
identifying relevant outcomes for clinical trials. The repli- 
cation of this study in other settings will be important for 
the development of a core outcome set for childhood 
asthma. We recommend that others adopt this broad em- 
pirical approach of attempting to align outcomes for 
assessing interventions in clinical trials with those that are 
used for making decisions in clinical practice. 

When making shared clinical decisions about daily 
management of childhood asthma, parents and clinicians 
wish to know whether an intervention controls symp- 
toms, prevents morbidity and mortality associated with 
exacerbations, and improves QoL. Outcomes in clinical 
trials, which generally measure short-term clinical and 
physiological efficacy, may not be sufficient to fully 
evaluate the effects of interventions that are meaningful 
in clinical practice. 

A core outcome set for childhood asthma that not only 
suits the needs of researchers, but also improves the use- 
fulness of clinical trials from the perspective of clinicians, 
parents, and policy-makers can be based on our findings 
in conjunction with the recommendations of the recent 
ATS/ERS taskforce. Agreement amongst a wider group 
of people involved in such trials should focus on identify- 
ing the best ways to measure symptoms and the effects 
of asthma on daily life. Standardising the definitions of 
endpoints, especially exacerbations, would also reduce 
heterogeneity between studies. Further discussion should 
also address the role of physiological measures of lung 
function in clinical trials in children with asthma, and 
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whether outcomes reflecting long-term beneficial and 
harmful effects of treatments should be measured in all 
such trials. 
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